Do Synesthetes Have a General Advantage in Visual Search and Episodic Memory? A Case for Group Studies

BACKGROUND: Some studies, most of them case-reports, suggest that synesthetes have an advantage in visual search and episodic memory tasks. The goal of this study was to examine this hypothesis in a group study. METHODOLOGY/PRINCIPAL FINDINGS: In the present study, we tested thirteen grapheme-color synesthetes and we compared their performance on a visual search task and a memory test to an age-, handedness-, education-, and gender-matched control group. The results showed no significant group differences (all relevant ps>.50). For the visual search task effect sizes indicated a small advantage for synesthetes (Cohen's d between .19 and .32). No such advantage was found for episodic memory (Cohen's d<.05). CONCLUSIONS/SIGNIFICANCE: The results indicate that synesthesia per se does not seem to lead to a strong performance advantage. Rather, the superior performance of synesthetes observed in some case-report studies may be due to individual differences, to a selection bias or to a strategic use of synesthesia as a mnemonic. In order to establish universal effects of synesthesia on cognition single-case studies must be complemented by group studies

No effect of synesthetic congruency on temporal ventriloquism

A sound presented in temporal proximity to a light can alter the perceived temporal occurrence of that light (temporal ventriloquism). Recent studies have suggested that pitch–size synesthetic congruency (i.e., a natural association between the relative pitch of a sound and the relative size of a visual stimulus) might affect this phenomenon. To reexamine this, participants made temporal order judgements about small- and large-sized visual stimuli while high- or low-pitched tones were presented before the first and after the second light. We replicated a previous study showing that, at large sound–light intervals, sensitivity for visual temporal order was better for synesthetically congruent than for incongruent pairs. However, this congruency effect could not be attributed to temporal ventriloquism, since it disappeared at short sound–light intervals, if compared with a synchronous audiovisual baseline condition that excluded response biases. In addition, synesthetic congruency did not affect temporal ventriloquism even if participants were made explicitly aware of congruency before testing. Our results thus challenge the view that synesthetic congruency affects temporal ventriloquism

Multimodal Chemosensory Integration through the Maxillary Palp in Drosophila

Drosophila melanogaster has an olfactory organ called the maxillary palp. It is smaller and numerically simpler than the antenna, and its specific role in behavior has long been unclear. Because of its proximity to the mouthparts, I explored the possibility of a role in taste behavior. Maxillary palp was tuned to mediate odor-induced taste enhancement: a sucrose solution was more appealing when simultaneously presented with the odorant 4-methylphenol. The same result was observed with other odors that stimulate other types of olfactory receptor neuron in the maxillary palp. When an antennal olfactory receptor was genetically introduced in the maxillary palp, the fly interpreted a new odor as a sweet-enhancing smell. These results all point to taste enhancement as a function of the maxillary palp. It also opens the door for studying integration of multiple senses in a model organism

Pseudo-Synesthesia through Reading Books with Colored Letters

Background Synesthesia is a phenomenon where a stimulus produces consistent extraordinary subjective experiences. A relatively common type of synesthesia involves perception of color when viewing letters (e.g. the letter ‘a’ always appears as light blue). In this study, we examine whether traits typically regarded as markers of synesthesia can be acquired by simply reading in color. Methodology/Principal Findings Non-synesthetes were given specially prepared colored books to read. A modified Stroop task was administered before and after reading. A perceptual crowding task was administered after reading. Reading one book (>49,000 words) was sufficient to induce effects regarded as behavioral markers for synesthesia. The results of the Stroop tasks indicate that it is possible to learn letter-color associations through reading in color (F(1, 14) = 5.85, p = .030). Furthermore, Stroop effects correlated with subjective reports about experiencing letters in color (r(13) = 0.51, p = .05). The frequency of viewing letters is related to the level of association as seen by the difference in the Stroop effect size between upper- and lower-case letters (t(14) = 2.79, p = .014) and in a subgroup of participants whose Stroop effects increased as they continued to read in color. Readers did not show significant performance advantages on the crowding task compared to controls. Acknowledging the many differences between trainees and synesthetes, results suggest that it may be possible to acquire a subset of synesthetic behavioral traits in adulthood through training. Conclusion/Significance To our knowledge, this is the first evidence of acquiring letter-color associations through reading in color. Reading in color appears to be a promising avenue in which we may explore the differences and similarities between synesthetes and non-synesthetes. Additionally, reading in color is a plausible method for a long-term ‘synesthetic’ training program

Dutch modality exclusivity norms : Simulating perceptual modality in space

Perceptual information is important for the meaning of nouns. We present modality exclusivity norms for 485 Dutch nouns rated on visual, auditory, haptic, gustatory, and olfactory associations. We found these nouns are highly multimodal. They were rated most dominant in vision, and least in olfaction. A factor analysis identified two main dimensions: one loaded strongly on olfaction and gustation (reflecting joint involvement in flavor), and a second loaded strongly on vision and touch (reflecting joint involvement in manipulable objects). In a second study, we validated the ratings with similarity judgments. As expected, words from the same dominant modality were rated more similar than words from different dominant modalities; but - more importantly - this effect was enhanced when word pairs had high modality strength ratings. We further demonstrated the utility of our ratings by investigating whether perceptual modalities are differentially experienced in space, in a third study. Nouns were categorized into their dominant modality and used in a lexical decision experiment where the spatial position of words was either in proximal or distal space. We found words dominant in olfaction were processed faster in proximal than distal space compared to the other modalities, suggesting olfactory information is mentally simulated as "close" to the body. Finally, we collected ratings of emotion (valence, dominance, and arousal) to assess its role in perceptual space simulation, but the valence did not explain the data. So, words are processed differently depending on their perceptual associations, and strength of association is captured by modality exclusivity ratings

Sandy ideas and coloured days: Some computational implications of embodiment

This paper is an exploration of the relationship between language and vision from the perspective of language evolution on the one hand, and metaphor on the other. Recent research has suggested that the origins of human language capacity can be traced to the evolution of a region in the brain that permits the interaction of information from sensory and motor cortices. In light of this, it is hypothesised that the computational mechanisms of language are derived from those of the sensory-motor domain, and that the pervasiveness of metaphor is one manifestation of language's computational antecedants. A variety of cognitive and computational implications are drawn from these hypotheses